Skip to content

Conversation

@huan233usc
Copy link
Collaborator

Which Delta project/connector is this regarding?

  • Spark
  • Standalone
  • Flink
  • Kernel
  • Other (fill in here)

Description

How was this patch tested?

Does this PR introduce any user-facing changes?

- Changed from baseDirectory.getParentFile/spark to (delta-spark-v1/baseDirectory).value
- This is more explicit and clearly shows we're using delta-spark-v1's directory
- Makes the relationship between modules more obvious
Issue: Test resource directories were using baseDirectory.getParentFile/spark
which could evaluate to the wrong path depending on evaluation order.

Solution: Changed all test path configurations to consistently use
(delta-spark-v1/baseDirectory).value:
- Test/unmanagedSourceDirectories
- Test/unmanagedResourceDirectories
- Test/resourceDirectory
- Test/baseDirectory
- Test/javaOptions (-Duser.dir)

This ensures all test paths correctly point to the spark/ directory
regardless of evaluation order, fixing GitHub Actions failures.
…java

- build.sbt: Removed old kernelSpark module (replaced by sparkV2 in our refactor)
- StreamingHelperTest.java: Use deltaLog.initialCatalogTable() instead of Option.empty()
This commit intentionally adds the same class (DuplicateTestClass) to both
sparkV1 and sparkV2 modules to test that the duplicate class detection in
build.sbt works correctly. The build should fail with an error message showing
the duplicate class.

This is a test commit to verify the duplicate detection mechanism works as
expected. It should NOT be merged.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant